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ABSTRACT 

Positive  definite  and  semidefinite  matrices  induce  well 
known  duality  results  in  quadratic  programming.  The  converse 
is  established  here.  Thus  if  certain  duality  results  hold 
for  a  pair  of  dual  quadratic  programs,  then  the  underlying 
matrix  must  be  positive  definite  or  semidefinite.  For  example 
if  a  strict  local  minimum  of  a  quadratic  program  exceeds  or 
equals  a  strict  global  maximum  of  the  dual,  then  the  underly¬ 
ing  symmetric  matrix  Q  is  positive  definite.  If  a  quadratic 
program  has  a  local  minimum  then  the  underlying  matrix  Q  is 
positive  semidefinite  if  and  only  if  the  primal  minimum 
exceeds  or  equals  ihe  dual  global  maximum  and  x  Qx  =  0  implies 
Qx  ■  0.  A  significant  implication  of  these  results  is  that 
the  Wolfe  dual  may  not  be  meaningful  for  nonconvex  quadratic 
programs  and  for  nonlinear  programs  without  locally  positive 
definite  or  semidefinite  Hessians,  even  if  the  primal  second 
order  sufficient  optimality  conditions  are  satisfied. 

AMS  (MOS)  Subject  Classifications:  90C20,  15A63 
Key  Words:  Positive  definite  matrices,  quadratic  programming, 
duality 
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SIGNIFICANCE  AND  EXPLANATION 


Constrained  optimization  problems  occur  in  dual  pairs 
when  certain  "valley"  conditions  (convexity  or  positive 
definiteness)  are  satisfied.  This  pairing  has  some  very 
useful  theoretical  and  computational  implications.  In  this 
work  we  show  the  converse,  namely  that  if  a  pair  of  problems 
are  connected  through  a  duality  relation  then  these  valley 
conditions  must  be  satisfied. 
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CHARACTERIZATION  OP  POSITIVE  DEFINITE  AND 
SEMIDEFINITE  MATRICES  VIA  QUADRATIC  PROGRAMMING  DUALITY 

S.-P.  Han  &  0.  L.  Mangasarian 

1.  INTRODUCTION 

It  is  well  known  [3,4,11,10]  that  the  dual  quadratic 
programs 

(la)  Minimize  yXTQx  +  pTx 

x 

subject  to  Ax  £  b 

Cx  *  d 

(lb)  Maximize  -  ixTQx  -  bTu  -  dTv 

x,u,v 

subject  to  Qx  +  ATu  +  CTv  +  p  «=  0 

u  >  0 

where  Q,  A  and  C  are  given  real  matrices  of  order  n*n, 

T 

m*n  and  kxn  respectively,  with  Q  *  Q  ,  and  p,  b  and  d 
are  given  vectors  in  the  real  finite  dimensional  Euclidean 
spaces  Rn,  Rm  and  Rk  respectively,  possess  many  important 
relations  when  Q  is  positive  semidefinite  or  positive  defi¬ 
nite.  In  this  paper  we  are  interested  in  the  converse:  What 
sort  of  duality  relations  between  (la)  and  (lb)  induce  posi¬ 
tive  definiteness  or  semidefinitness  in  Q?  A  key  role  in 
deriving  these  converse  relations  is  played  by  the  following 
conjugate  cone  characterization  of  positive  definite  and  semi¬ 
definite  matrices  [8]. 

1.1  Theorem  [8]  Let  K  be  a  nonempty  convex  polyhedral  cone 
in  Rn.  The  n*n  real  matrix  P  is  positive  semidefinite  if 
and  only  if  P  is  positive  semidefinite  plus  on  the  cone  K 

p 

and  positive  semidefinite  on  the  conjugate  cone  K  ,  that  is 

x«  K  ■>  xTPx  >  0 

(2)  T  "  , 

x  Px  =  0,  xtK  ■»  (P+PA)x  =  0 
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(3)  y«KP:»  {yjy(P+PT)x <  0,  Vx  £  K}  yTPy  >  0 

1.2  Theorem  [8]  Let  K  be  a  nonempty  convex  polyhedral  cone 
in  Rn.  The  n*n  real  matrix  P  is  positive  definite  if  and 
only  if  P  is  positive  definite  on  K  and  that  is: 

0  f1  x  £  K  xTPx  >  0 

0  ft  y  £  yTPy  >  0 

With  the  help  of  these  characterization  theorems  and  the 
second  order  optimality  conditions  of  quadratic  programming 
[6, 9, 2,1]  we  show  for  example  in  Theorem  3.5  that  if  a  strict 
local  minimum  of  a  quadratic  program  exceeds  or  equals  a  strict 
global  maximum  of  the  dual,  then  the  matrix  Q  must  be  posi¬ 
tive  definite.  In  Theorem  3.6  we  show  that  if  a  quadratic 
program  has  a  local  minimum  then  Q  is  positive  semidefinite 

if  and  only  if  the  primal  minimum  exceeds  or  equals  the  dual 

T 

global  maximum,  and  Qx  »  0  whenever  x  Qx  =  0.  in  Corollary 
3.7  we  show  that  if  the  primal  feasible  and  dual  feasible  sets 
are  nonempty  and  if  the  weak  duality  relation  holds,  that  is 
the  primal  objective  exceeds  or  equals  the  dual  objective  over 
their  respective  feasible  regions,  and  if  Qx  *  0  whenever 
x  Qx  *  0,  then  Q  is  positive  semidefinite.  In  [7]  positive¬ 
definiteness  of  the  Hessian  of  the  Lagrangian  of  nonlinear 
programs  was  established  under  more  restrictive  assumptions. 

The  import  of  these  and  our  other  results  is  that  when 
certain  simple  and  desirable  duality  results  are  satisfied  by 
a  pair  of  dual  quadratic  programs,  then  the  underlying  matrix 
must  be  positive  definite  or  semidefinite.  This  leads  to  the 
conclusion  that  the  Dennis-Dorn-Wolfe  quadratic  dual  programs 
[3,4,11]  are  meaningful  only  if  the  underlying  matrix  is 
positive  definite  or  semidefinite.  Ibr  example  even  if  the 
primal  quadratic  problem  (la)  has  a  unique  global  minimum 
solution  (and  thus  satisfying  the  second  order  sufficient 
optimality  condition) ,  and  if  the  underlying  matrix  is  not 
positive  semidefinite  then  the  dual  quadratic  problem  (lb)  may 
not  make  sense.  Thus  the  example 
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minimize  x^  -  x2  subject  to  x2  =  0 
has  the  unique  global  solution  x^  *  x2  ®  0  but  its  dual 


maximize 


x2  +  ^2 


subject  to  x^  =  0 ,  -2x2  +  v  *  0 


is  unbounded  above.  Similarly  the  Wolfe  dual  for  nonlinear 
programs  may  not  be  meaningful  unless  the  Hessian  of  the 
Lagrangian  is  locally  positive  definite  or  semidefinite  in  the 
neighborhood  of  a  stationary  point  of  the  primal  problem  [7]. 
Thus  even  if  the  second  order  sufficient  optimality  conditions 
are  satisfied  but  the  Hessian  of  the  Lagrangian  is  not  positive 
definite  or  semidefinite  in  a  neighborhood  of  a  local  minimum 
solution,  the  dual  problem  may  not  make  sense. 

We  shall  need  second  order  optimality  conditions  for  the 
dual  quadratic  programs  (la)  and  (lb)  which  have  local  and 
strictly  local  solutions.  These  results  can  be  found  in 
[9,2,1]  which  we  summarize  here  in  a  convenient  form.  The 
points  (x,u,v)  €  Rn+m+k  and  (£,5,v,w)  e  Rn+m+k+n  are  Karush- 
Kuhn-Tucker  points  of  (la)  and  (lb)  respectively  if  they 
satisfy  the  following  respective  conditions  [10] 


(4a) 


Ax  <  b 
Cx  =  d 


u  >  0 
uT (Ax-b)  =  0 


(4b)  -Qx  +  Qw  =  0 

Aw  -  b  <  0 
Cw  -  d  =  0 
Qx  +  ATu  +  CTv  +  p  ■  0 

u  >  0 
uT (Aw-b)  =  0 


Mote  that  if  (x,u,v)  is  a  Karush-Kuhn-Tucker  point  of  (la) 
then  (x,u,v,x)  is  a  Karush-Kuhn-Tucker  point  of  (lb) .  To 
characterize  local  solutions  we  need  to  define  the  following 
index  sets  associated  with  a  Karush-Kuhn-Tucker  point  (x,u,v) 
of  (la) : 
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J :=  (ijA^x^b^,  5i>0} 

K:=  {ijA^x  =  b^f  =  0} 

E:«  JuK  =  { i } Aix  =  b^ 

I:=  { i | A^x  <  bi#  G.  =  0} 

The  notation  Ag  will  represent  the  rows  A^  of  A  with 
i e  E.  We  can  now  state  the  following. 

1.3  Theorem  [2,1]  (Characterization  of  local  solutions  of 
quadratic  programs)  A  point  x  c  Rn  is  local  minimum  solution 
of  the  quadratic  program  (la)  if  and  only  if  x  and  some 
(u,v)  €  R®+Ic  satisfy  the  Karush-Kuhn-Tucker  conditions  (4a)  and 

(5a)  AgX  <0,  Cx  =  0  ■*  xTQx  >  0 

The  Karush-Kuhn-Tucker  point  (x,u,v)  of  (la)  is  a  local 
maximum  solution  of  the  dual  quadratic  program  (lb)  if  and  only 
if 

(5b)  Qx  +  ATu  +  CTv  »  0,  (uK,Uj)  >  0  «*•  xTQx  >  0 

1.4  Theorem  [9,2,1]  (Characterization  of  strict  local  solu¬ 
tions  of  quadratic  programs)  A  point  x  «  Rn  is  a  strict  local 
minimum  solution  of  the  quadratic  program  (la)  if  and  only  if 

x  and  some  (u,v)  e  R?n+,c  satisfy  the  Karush-Kuhn-Tucker 
conditions  (4a)  and 

(6a)  AjX  ■  0,  Arx  <  0,  Cx  =  0,  x  ?  0  -  xTQx  >  0 

The  Karush-Kuhn-Tucker  point  (x,u,v)  of  (la)  is  a  strict 
local  maximum  solution  of  the  dual  quadratic  program  (lb)  if 
and  only  if 

i 

(6b)  Qx  +  ATu  +  CTv  =  0 ,  uR>0,  Uj”0,  (x,u,v)  ^  0  «*xTQx  >  0. 

In  the  next  two  sections  we  characterize  positive  definite 
and  seroidefinite  problems  in  terms  of  equality-constrained 
quadratic  programs  (Section  2)  and  inequality-constrained 
quadratic  programs  (Section  3) .  This  split  into  equality-  and 


inequality-constrained  problems  permits  the  statement  of  some¬ 
what  sharper  results  for  the  former.  For  simplicity  we  con¬ 
fine  the  results  of  Section  3  to  inequality  constraints  only. 
Problems  with  both  equality  and  inequality  constraints  can  be 
handled  in  a  straightforward  extension  of  the  results  of 
Section  3. 
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2.  EQUALITY-CONSTRAINED  QUADRATIC  PROGRAMS 

We  specialize  here  the  dual  problems  (la)  and  (lb)  to  the 
following  equality-constrained  dual  quadratic  programs 

(7a)  Minimize  ixTQx  +  pTx  (7b)  Maximixe  -^xTQx-dTv 

x  *  x,v  1 

T 

subject  to  Cx  =  d  subject  to  Qx  +  C  v  +  p  =  0 

We  say  that  a  problem  is  feasible ,  if  the  set  of  points 
satisfying  its  constraints  is  nonempty. 

2.1  Theorem  (Characterization  of  positive  semidefinite  and 
definite  matrices)  Let  (7a)  be  feasible. 

(i)  Let  (7b)  be  feasible.  A  necessary  and  sufficient 
condition  for  Q  to  be  positive  semidefinite  is 
that  (7a)  has  a  local  minimum,  (7b)  has  a  local 
maximum  solution  and 

T 

(8)  x  Qx  =  0,  Cx  =  0  ^  Qx  =  0 

(ii)  A  sufficient  condition  for  Q  to  be  positive 

definite  is  that  (5a)  has  a  strict  local  minimum 
solution  and  (5b)  has  a  strict  local  maximum  solu¬ 
tion.  This  condition  is  also  necessary  if  C  has 
linearly  independent  rows. 

Proof  (i)  Necessity  follows  from  existence  and  duality  theory 
of  convex  quadratic  programming  [5,10].  We  establish  suffi¬ 
ciency  now  by  means  of  Theorem  1.1.  Define 

(9)  K:-{x|Cx=0) 

Then 

(10)  K°:«  {y|yTQx<0,  Vx  e  K) 

■  {y|yTQx  >0,  Cx  =  0  has  no  solution  x) 

■  {y|0y  +  cTv  =  0} 

Since  (7a)  has  a  local  minimum  solution  it  follows  by 
Theorem  1.3  (5a)  and  (9)  that 
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(11)  xTQx  >,  0  for  x  e  K 

Since  (7b)  has  a  local  maximum  solution,  it  follows  also  by 
Theorem  1.3  (5a)  and  (10)  that 

(12)  yTQy  >  0  for  y  c  K° 

Hence  by  (11),  (8),  (12)  and  Theorem  1.1,  Q  is  positive 
semidefinite. 

(ii)  (Necessity)  That  both  (7a)  and  (7b)  have  solutions 
follows  from  the  feasibility  of  (7a)  and  the  positive  definite¬ 
ness  of  Q.  The  uniqueness  of  solution  for  (7a)  follows  from 
the  positive  definitness  of  Q.  The  uniqueness  of  solution  for 
(7b)  follows  from  the  positive  definiteness  of  Q,  the  linear 
independence  of  the  rows  of  C  and  Theorem  1.4  (6b). 

(Sufficiency)  We  establish  sufficiency  by  means  of 
Theorem  1.2.  Since  (7a)  has  a  strict  local  minimum  solution 
it  follows  by  Theorem  1.4  (6a)  and  (9)  that 

(13)  xTQx  >  0  for  0  /  xeK 

Since  (7b)  has  a  strict  local  maximum  solution,  it  follows  also 
by  Theorem  1.4  (6a)  that 

xTQx  >  0  for  Qx  +  CTv  =  0,  (x, v)  /  0 

and  hence  by  (10) 

(14)  yTQy  >0  for  0  ?  y  e  K° 

Hence  by  (13),  (14)  and  Theorem  1.2,  Q  is  positive 
definite.  □ 


3.  INEQUALITY-CONSTRAINED  QUADRATIC  PROGRAMS 

We  turn  our  attention  now  to  the  following  inequality 
constrained  dual  quadratic  programs 

ITT  ITT 

(15a)  Minimize  yX  Qx  +  p  x  (15b)  Maximize  -  rx  Qx  -  b  u 

X  x,u 

T 

subject  to  Ax£b  subject  to  Cx  +  A  u  +  p=0 

u  >  0 

3.1  Theorem  (Characterization  of  positive  semidefinite  and 
definite  matrices)  Let  (15a)  be  feasible. 

(i)  Let  (15b)  be  feasible.  A  necessary  and  sufficient 
condition  for  Q  to  be  positive  semidefinite  is 
that  (15a)  has  a  local  minimum  solution  x  with 
multiplier  u,  that  (x,u)  is  a  local  maximum 
solution  of  (15b)  and 

T 

x  Qx  «  0,  AjX  ■  0,  Aj^x  <  0  «*•  Qx  »  0 

A  sufficient  condition  for  Q  to  be  positive 
definite  is  that  (15a)  have  a  strict  local  minimum 
solution  x  with  multiplier  u,  and  (x,u)  is  a 
strict  local  maximum  solution  of  (15b) .  If  in 
addition  the  rows  of  Aj  are  linearly  independent, 
AjX  *  0,  Aj^x  >  0  has  a  solution,  then  this  condi¬ 
tion  is  also  necessary. 

Necessity  follows  from  existence  and  duality  theory 
of  convex  quadratic  programs.  We  establish  sufficiency  now  by 
means  of  Theorem  1.1.  Define 

(17)  K:«  {x|AjX  =  0,  Arx<0}  c  {x|Aex<0} 

Then 

K°={y  1  yTQx< 0 , Vx€K)={y  I yTQx>0 ,AjX=0 ,ARx<0 ,  has  no  solution  x} 

"(ylQy-Ajuj-Ajuj^O,  uR>0} 

Therefore 


(16) 

(ii) 


Proof  (i) 


(18) 


-kP  **{x|Qx+ATu=0,  uKj>0,  Uj=0} 
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Since  x  is  a  local  minimum  solution  of  (15a)  with  multiplier 
u  it  follows  from  Theorem  1.3  (5a)  and  (17)  that 

(19)  xTQx  >,  0  for  x  e  K 

Since  (x,u)  is  also  a  local  maximum  solution  of  (15b)  it 
follows  from  Theorem  1.3  (5b)  and  (18)  that  xTQx  >  0  for 
for  x  «  -K  which  is  equivalent  to 

(20)  xTQx  >0  for  x  €  K° 

Conditions  (19),  (16)/  (20)  and  Theorem  1.1  imply  that  Q  is 

positive  semidefinite. 

(ii)  (Necessity)  That  both  (15a)  and  (15b)  have  solutions 
follows  from  the  feasibility  of  (15a)  and  the  positive  definite¬ 
ness  of  Q.  The  uniqueness  of  solution  of  (15a)  follows  from 
the  positive  definitness  of  Q.  The  uniqueness  of  solution  of 
(15b)  follows  from  the  positive  definiteness  of  Q,  the  linear 
independence  of  the  rows  of  Aj,  the  existence  of  a  solution 
to  AjX  *  0,  AjjX  >  0  and  Theorem  1.4  (6b). 

(Sufficiency)  We  establish  sufficiency  by  means  of 
Theorem  1.2.  Since  (15a)  has  a  strict  local  minimum  solution 
x  it  follows  by  Theorem  1.4  (6a)  and  (17)  that 

(21)  xTQx  >0  for  0  ^  x  «  K 

Since  (x,u)  is  a  strict  local  maximum  solution  of  (15b)  it 
follows  from  Theorem  1.4  (6b)  and  (18)  that 

(22)  xTQx  >0  for  0  ^  x  c  K° 

Hence  by  (21),  (22)  and  Theorem  1.2,  Q  is  positive 
definite.  □ 

3.2  Corollary  (Globalization  of  local  dual  solutions) 

(i)  Let  x  be  a  local  minimum  solution  of  (15a)  with 
multiplier  u,  let  (x,u)  be  a  local  maximum 
solution  of  (15b)  and  let  (16)  hold.  Then  Q  is 
positive  semidefinite  and  hence  x  is  a  global 


minimum  solution  of  (15a)  and  (x,u)  is  a  global 
maximum  solution  of  (15b) . 

(ii)  Let  x  be  a  strict  local  minimum  solution  of  (15a) 
with  multiplier  u,  let  (x,u)  be  a  strict  local 
maximum  solution  of  (15b)  then  Q  is  positive 
definite  and  hence  x  is  a  global  strict  minimum 
solution  of  (15a)  and  (x,u)  is  a  global  maximum 
solution  of  (15b) . 

He  note  that  condition  (16)  of  Theorem  3.1  cannot  be 
dispensed  as  shown  by  the  following  pair  of  dual  programs: 


Minimize 


X1X2 


Maximize 


xlx2 


subject  to 


x1  >  0 
*2  -  0 


subject  to 


X1  “  u2  -  0 


x2“ul 


(uiru2)  >  0 


Clearly  (x^,x2)  =  (0,0)  is  a  global  solution  to  the  primal 
problem,  (x^x^u^Uj)  =  (0,0, 0,0)  is  a  Karush-Kuhn-Tucker 
point  for  the  primal  problem  as  well  as  a  global  solution  to 

the  dual  problem.  However  the  underlying  matrix  Q  *  ||  jj 

is  not  positive  semidefinite  because  condition  (16)  is 
violated. 

We  establish  now  other  duality  results  which  induce  posi¬ 
tive  definiteness  or  semidefiniteness.  We  begin  by  a  few 
preliminary  results. 


3.3  Lemma  Let  (x,u)  satisfy  the  Karush-Kuhn-Tucker  condi 
tions  of  (15a) .  Then 

(23)  |xTQx  +  PT*  -  -|xTQx  -  bTu 


implies  that 
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Proof  Prom  the  Karush-Kuhn-Tucker  conditions  of  (15a)  we  have 
that 

-x  Qx  -  p  x  -  b  u  »  0 

which  when  added  to  (23)  yields  (24) .  □ 

3.4  Lemma  Let  (x,u)  satisfy  the  Karush-Kuhn-Tucker  condi¬ 
tions  of  (15a)  such  that  for  all  (x,u)  feasible  for  the  dual 
quadratic  program  (15b) 

(25)  j-xtQx  +  pTx  >_  -|xTQx  -  bTu 

Then  (x,u)  solves  (15b). 

Proof  Since  (x,u)  is  feasible  for  the  dual  quadratic  program 
(15b)  and  since  by  (25}  and  Lemma  3.3 

- ^  xTQx  -  bTu  >  - j xTQx  -  bTu 

for  all  dual  feasible  (x,u) ,  it  follows  that  (x,u)  solves 
(15b) .  0 

3.5  Theorem  (Sufficient  condition  for  positive  definiteness) 

If  a  strict  local  minimum  of  the  quadratic  program  (15a) 
exceeds  or  equals  a  strict  global  maximum  of  the  dual  quadratic 
program  (15b)  then  Q  is  positive  definite. 

Proof  Let  u  be  a  multiplier  associated  with  the  strict  local 
minimum  solution  of  (15a).  By  Lemma  3.4,  (x,u)  is  a  global 
maximum  solution  of  (15b) .  By  assumption  this  global  maximum 
is  strict.  Hence  by  Theorem  3.1  (ii)  Q  is  positive 
definite.  □ 

3.6  Theorem  (Characterization  of  positive  semidefinite 
matrices)  Let  x  be  a  local  minimum  solution  of  (15a) .  The 
matrix  Q  is  positive  semidefinite  if  and  only  if  (16)  holds 
and  for  any  dual  feasible  (x,u) 

1  -T  -  T-  IT  T 

jx'Qx  +  p  x  >  -jXaQx  -  b  u 


(26) 
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Proof  Necessity  follows  from  the  duality  theory  of  quadratic 
programming  and  the  fact  that  x  Qx  =  0  implies  Qx  =  0  for 
any  symmetric  positive  semidefinite  matrix.  To  prove  suffi¬ 
ciency  we  note  that  there  exists  a  u  such  that  (x,u)  is  a 
Karush-Kuhn-Tucker  point  of  (15a)  and  by  (26)  and  Lemma  3.4, 
(x,u)  is  a  global  maximum  solution  to  (16b) .  Hence  by 
Theorem  3.1  (i)  Q  is  positive  semidefinite. 

A  direct  consequence  of  Theorem  3.6  is  the  following 
characterization  of  positive  semidefinite  matrices  in  terms  of 
the  weak  duality  [10]  relation  of  quadratic  programs. 

3.7  Corollary  (Positive  semidefiniteness  via  weak  duality) 

Let  the  quadratic  programs  (15a)  and  (15b)  be  feasible.  The 
matrix  Q  is  positive  semidefinite  if  and  only  if  for  all 
primal  feasible  x  and  all  dual  feasible  (y,u) 

(27)  jXTQx  +  pTx  >  -|yTQy  -  bTu 
and 

(28)  zTQz  «  0  4  Qz  =  0 
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